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ABSTRACT 

Integrated  simulation  capabilities  that  are  high-fidelity ,  fast,  and  have  scalable 
architecture  are  essential  to  support  autonomous  vehicle  design  and  performance  assessment  for 
the  U.S.  Army's  growing  use  of  unmanned  ground  vehicles  (UGV).  The  HMMWV  simulation 
described  in  this  paper  embodies  key  features  of  the  real  vehicle,  including  a  complex  suspension 
and  steering  dynamics,  wheel-soil  models,  navigation,  and  control.  This  research  uses  advanced 
multibody  techniques  such  as  minimal  coordinate  representations  with  constraint  embedding  to 
model  complex  unmanned  ground  vehicles  for  fast  mechanical  simulations  with  high  fidelity.  In 
this  work,  we  demonstrate  high-fidelity  dynamics  models  for  autonomous  UGV  simulations  in  near 
real  time  that  can  be  useful  to  the  U.S.  Army  for  future  autonomous  ground  vehicle  dynamics 
modeling  and  analysis  research. 


INTRODUCTION 

With  increased  onboard  autonomy,  advanced  vehicle 
models  are  needed  to  analyze  and  optimize  control  design 
and  sensor  packages  over  range  of  urban  and  off-road 
scenarios.  Moreover,  integrated  simulation  capabilities  that 
are  high-fidelity,  fast,  and  have  scalable  architecture  are 
essential  to  support  autonomous  vehicle  design  and 
performance  assessment  for  the  U.S.  Army’s  growing  use  of 
unmanned  ground  vehicles. 

Recent  work  at  TARDEC  has  attempted  to  develop  a  high- 
fidelity  mobility  simulation  of  an  autonomous  vehicle  in  an 
off-read  scenario  using  integrated  sensor,  controller,  and 
multi-body  dynamics  models  [1].  The  conclusion  was  that 
(a)  real-time  simulation  was  not  feasible  due  to  the 
complexity  of  the  intervening  formulation,  (b)  models  had  to 
be  simplified  to  speed  up  the  simulation,  (c)  interfacing  the 
sensors  was  exceedingly  difficult  due  to  co- simulation,  (d) 
the  controls  developed  were  very  basic  and  could  not  be 
optimized,  and  (e)  a  rigid  terrain  model  was  used. 

The  JPL  ROAMS  ground  vehicle  simulation  framework  is 
based  on  the  JPL  Darts/Dshell  simulation  architecture  [2], 
[3],  [4],  [5].  ROAMS  and  the  underlying  architecture  have 
been  successfully  demonstrated  at  JPL  in  several  space 
mission-critical  scenarios  where  a  high  degree  of  mission 


complexity,  real-time  performance,  and  extensive 
sensor/actuator/control  integration  were  necessary.  The 
underlying  framework  has  been  applied  to  a  variety  of 
mission-critical  simulation  needs  for  NASA  missions  across 
multiple  domains  (cruise/orbiter,  landers,  and  rovers)  over 
the  years.  The  architecture  has  supported  real-time 
embedded  hardware-in-the-loop  use  to  large-scale  Monte 
Carlo  based  parametric  studies.  Lor  further  information 
about  the  ROAMS,  please  visit  the  JPL  DARTS  Lab 
website:  http://dartslab.jpl.nasa.gov. 

ROAMS  is  unique  in  its  integrated  approach  to  straddling 
the  multi-function  high-fidelity  dynamics,  sensors, 
environment,  control,  and  autonomy  models  that  are  key 
attributes  of  future  Army  unmanned  ground  vehicles 
(UGVs).  This  project  will  facilitate  the  transfer  of  this 
technology  to  TARDEC  so  that  customers  such  as  RS  JPO 
and  DARPA  can  be  supported. 

This  project  is  a  pilot  effort  to  demonstrate  the  application 
of  the  ROAMS  modeling  approach  for  addressing  the 
fidelity  and  speed  bottlenecks  for  TARDEC  and  the  Army’s 
needs  for  the  evaluation  and  testing  of  autonomous  ground 
vehicles.  The  simulation  architecture  represents  a  shift  in 
paradigm  in  empowering  analysts  with  full  visibility  and 
control  in  tailoring  key  elements  of  the  simulator.  This 
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scalable  architecture  allows  the  adaptation  and  tuning  of 
simulation  fidelity  across  a  very  broad  range  (e.g.  rigid/flex- 
body  dynamics,  sensor  fidelity,  dynamics/kinematics  modes) 
needed  for  the  multi-layered  testing  of  complex  autonomy 
behaviors.  This  feature  is  in  contrast  with  alternative 
approaches  that  focus  on  specific  aspects  such  as  sensor 
fidelity,  vehicle  dynamics,  or  behavioral  models  that  address 
only  a  narrow  slice  of  vehicle  autonomy  simulation  needs. 
This  simulation  approach  has  been  successfully  used  by 
analysts  across  multiple  NASA  centers  for  a  variety  of 
problems. 

This  project  developed  and  demonstrated  an  integrated 
simulation  capability  consisting  of  real-time,  high-fidelity 
dynamics  with  control,  sensors,  and  environment  models  in 
the  loop  for  a  representative  TARDEC  autonomous  vehicle. 
Leveraging  prior  work  done  at  JPL  for  autonomous 
planetary  rovers,  the  team  adapted  the  JPL’s  ROAMS 
vehicle  simulation  framework  to  develop  vehicle  models 
with  the  following  attributes:  multibody  dynamics  based  on 
the  fast  recursive  order-N  spatial  algebra  formulation, 
wheeled  locomotion  capability,  vehicle  model  based  on  a 
common  military  vehicle  (the  HMMWV),  selected  models 
of  sensors  (cameras,  GPS,  radar,  LIDAR),  and  actuators,  off¬ 
road  compliant  terrains  with  Bekker/Terazaghi  soil 
interaction  models  [3],  drive-to-goal  locomotion  planning 
with  obstacle  avoidance,  drive/steer  to  maintain  the  vehicle 
stable  while  following  a  prescribed  path  and  avoiding 
obstacles,  and  3D  real-time  graphics  visualization  and  data 
logging  capability. 

The  simulator’s  architecture  will  allow  the  seamless 
selection  of  different  fidelity  levels  and  model  parameters 
across  the  full  modeling  suite,  and  more  importantly, 
provide  analysts  with  a  modular  way  to  swap  component 
models  for  varying  vehicle/control/sensor  behavior. 

MODELING  THE  HMMWV  SUSPENSION  SYSTEM 

The  HMMWV  suspension  system  is  a  variant  of  the 
common  double  wishbone  suspension.  These  suspension 
systems  have  a  large  number  of  distinct  bodies  that  are 
contained  within  a  single  kinematic  closed  loop.  As  a  result, 
these  suspensions  have  a  large  number  of  internal  degrees  of 
freedom,  but  due  to  the  constraints  imposed  by  them  to  a 
frame  or  chassis,  they  only  have  a  single  independent  degree 
of  freedom1. 

There  are  two  issues  that  arise  from  constrained  systems  in 
computational  dynamics  modeling.  The  first  is  the  added 
computation  required  to  satisfy  the  constraints  on  the 
system.  The  second  is  the  error  drift  that  results  over  time 
from  the  discretized  integration  of  the  multibody  dynamics 


1  This  assumes  that  the  suspension  joints  are  represented 
as  pin  joints.  When  explicitly  modeled,  bushings  introduce 
additional  degrees  of  freedom. 


equations.  This  error  drift  is  usually  handled  by  error 
correction  algorithms  that  are  imposed  after  each  discretized 
step  to  minimize  the  constraint  error  over  time,  adding  even 
more  computation  for  each  constraint. 

For  the  HMMWV  suspension  modeling,  we  have  tested 
and  benchmarked  three  algorithmic  techniques  to  solve  the 
multibody  dynamics  of  the  suspension  system.  While  the 
HMMWV  suspension  model  is  the  same,  the  difference 
between  the  three  techniques  is  the  number  of  constraints 
that  are  needed,  which  directly  affects  their  resultant 
computational  speed.  These  techniques  are  described  in  the 
following  paragraphs  as  well  as  a  later  section;  for  more 
detail,  please  see  [6] . 

The  first  technique  is  known  as  the  fully  augmented  (FA) 
technique  and  models  each  body  in  the  system  as  fully 
independent  (with  six  degrees  of  freedom)  and  then  imposes 
constraints  between  the  rigid  bodies  to  simulate  the 
connectivity  of  the  system.  This  results  in  a  large  number  of 
constraints,  however  the  dynamics  computation  is  relatively 
simple  due  to  the  assumption  that  all  of  the  bodies  are 
independent.  The  computations  involved  are  order  0(N3) 
where  N  is  the  number  of  bodies. 

The  second  technique  is  known  as  the  tree  augmented 
(TA)  technique  where  constraints  are  only  imposed  in  closed 
chains.  This  is  done  by  taking  the  multibody  system  and 
converting  it  to  a  tree  topology  by  “cutting”  any  closed 
chains  and  imposing  a  constraint  at  the  cut.  The  rest  of  the 
tree  topology  system  is  then  modeled  using  minimal 
coordinates.  This  results  in  constraints  only  appearing  in 
closed  chains,  however  the  minimal  coordinates  computation 
is  significantly  more  difficult  than  in  the  FA  case.  For  TA, 
the  computations  involved  are  order  O(N). 

The  final  technique  is  known  as  the  constraint  embedded 
(CE)  technique  which  converts  all  closed  chains  into 
variable  shape  compound  bodies  which  have  the  same 
number  of  degrees  of  freedom  as  the  number  of  independent 
degrees  of  freedom  for  the  closed  chain  systems  they 
replace.  These  compound  bodies  locally  handle  their  internal 
degrees  of  freedom  and  constraint,  effectively  hiding  them 
from  the  dynamics  solver.  As  a  result,  the  CE  method  has  no 
constraints.  For  CE,  the  computations  involved  are  order 
O(N). 

In  general  for  small  closed  chain  systems  embedded  in  a 
multibody  system,  the  CE  technique  is  significantly  faster 
than  the  TA  or  the  FA  technique.  This  is  because  the  CE 
technique,  which  hides  the  constraints  in  compound  bodies, 
is  able  to  directly  use  the  fast  recursive  algorithms  for  tree 
systems. 

We  used  a  standalone  suspension  model  for  one  wheel 
(this  is  sometimes  called  a  “quarter-car”  model)  to  develop 
CE  models  and  benchmark  its  performance  against  the  TA 
and  FA  approaches.  See  Figure  1. 
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Figure  1:  Single  standalone  HMMWV  “quarter-car” 
wheel  suspension  model 

The  quarter-car  model  includes  the  double  “A-arm” 
closed-chain  mechanism  and  the  associated  spring-damper 
unit.  We  tested  the  quarter-car  model  by  running  a 
simulation  by  applying  a  known  force  profile  to  the  wheel 
over  a  period  of  several  seconds.  We  tested  and 
benchmarked  the  suspension  model  by  using  the  three 
techniques  for  modeling  the  closed  chain  mechanism 
described  previously.  All  three  approaches  produced  the 
same  motions,  providing  a  degree  of  cross-validation. 

The  CE  technique  proved  to  be  both  the  fastest  and  have 
the  least  constraint  error  over  time.  The  next  fastest  was  the 
TA  method,  followed  by  the  non-analytic  CE  method. 
Normally,  the  CE  technique  solves  the  internal  system  using 
an  iterative  approach;  however  we  eventually  developed  a 
analytic  solver  for  the  quarter-car  suspension  system,  which 
further  reduced  the  dynamics  computation  time.  Adding 
bushings  may  require  different  algorithms  for  the  closed- 
loop  calculations.  The  parameters  for  the  suspension  system 
were  determined  from  an  ADAMS  model  provided  by  the 
sponsor  [1]. 

To  integrate  the  suspension  model  into  the  full  HMMWV 
model,  the  rear  suspensions  were  simply  attached  to  the 
chassis.  However,  the  front  suspensions  required  an 
additional  steering  mechanism,  which  was  modeled  as  a 
four-bar  closed  chain  to  which  the  suspension  tie  rod  was 
connected.  The  result  was  a  coupled  steering  system  that 
uses  the  steer  angle  as  a  single  independent  degree  of 
freedom  in  the  four-bar  which  in  turn  steers  both  suspension 
systems. 

HMMWV  Vehicle  Parameters  and  Graphical 
Representation 

The  kinematic  and  mass  properties  for  this  HMMWV 
simulation  were  taken  from  an  ADAMS  model  developed  by 
[7]  and  provided  to  us  by  the  task  sponsor.  The  CAD 
models  for  the  graphical  representation  were  also  taken  from 


the  same  ADAMS  model  and  converted  to  suitable  forms  to 
use  in  the  simulations. 

The  wheel- soil  interaction  parameters  are  similar  to 
parameters  that  we  have  used  in  past  ROAMS  planetary 
rover  simulations  and  are  representative  of  moderately  firm 
sandy  soil  [3]. 


Figure  2:  HMMWV  Simulation  Model 


Closed-Chain  Suspension  Modeling 

In  this  section  we  outline  some  of  the  mechanism 
modeling  advances  [6]  that  were  used  to  construct  the 
vehicle  simulation  for  this  task. 

Here  we  consider  the  dynamics  of  multibody  systems  with 
closed-loop  topologies  such  as  in  Figure  3.  The  relative 
motion  between  adjacent  bodies  in  a  multibody  system  is 
constrained.  There  are  several  approaches  to  handle  systems 
with  internal  closed  loop  constraints.  Such  inter-body 
constraints  may  be  treated  as  hinges,  or  as  closure 
constraints  between  the  bodies.  In  the  hinge  approach,  the 
constraint  is  eliminated  from  the  equations  of  motion  by 
using  minimal  relative  coordinates  to  parameterize  the 
allowable  motion  between  the  body  pair.  On  the  other  hand, 
the  closure  constraint  approach  employs  non-minimal 
coordinates  and  utilizes  bilateral  constraints  and  Lagrange 
multipliers  to  enforce  the  restricted  motion  between  body 
pairs. 


Figure  3:  A  closed-chain  multibody  system  with  an 
internal  closed  loop  constraint 
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While  the  use  of  hinges  leads  to  equations  of  motion  with 
smaller  dimension,  the  accompanying  minimal  coordinates 
exhibit  a  high  degree  of  dynamical  coupling  and  a  more 
complex  formulation.  However,  the  added  complexity  can 
be  mitigated  by  the  use  of  structure -based,  low  order, 
recursive  methods  for  the  dynamics  computations.  In 
contrast,  the  exclusive  use  of  closure  constraints  leads  to 
larger,  but  structurally  simpler  form  of  the  equations  of 


motion.  More  generally,  closed-chain  models  contain  a 
hybrid  combination  of  hinges  and  closure  constraints,  with 
the  hinges  being  associated  with  a  tree  topology  sub-system 
within  the  overall  model.  The  following  three  approaches  for 
closed-chain  dynamics  span  the  range  of  these  modeling 
options: 


# 


(a)  Fully  Augmented 
(FA)  model  (DAE) 


(b)  Tree  Augmented 
(TA)  model  (DAE) 


% 


(c)  Constraint  Embedding 
(CE)  model  (ODE) 


Non-m  inimal  coords 
+  constraints 

Sim  pie  setup 


Minimal  tree  coords 
+  constrain  ts 


Better  for  large  loops 


Minimal  coords 
Optim  alfor  sm  all  loops 


Figure  4:  In  the  fully  augmented  model  (FA),  all  bodies  are  treated  as  independent  bodies  with  inter -body  constraints.  In  the  tree 
augmented  model  (TA),  the  system  is  decomposed  into  a  tree  system  together  with  a  minimal  set  of  inter-body  constraints.  In  the 
constraint  embedding  model  (CE),  internal  loops  are  aggregated  into  bodies  to  convert  the  system  into  a  tree  topology  system. 
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Fully-augmented  (FA)  method:  The  first  method  is  the 
fully-augmented  (FA)  dynamics  method.  In  this  method,  all 
bodies  are  modeled  as  independent  bodies  using  absolute 
coordinates,  and  the  restricted  relative  motion  is  modeled  via 
closure  constraints  as  shown  in  Figure  4(a).  The  advantage 
of  this  approach  is  that  the  equations  of  motion  are  simple 
and  easy  to  set  up.  The  mass  matrix  of  the  tree  sub-system  is 
block  diagonal  and  constant.  Sparse  matrix  solution 
techniques  can  be  used  to  solve  for  Lagrange  multiplier 
constraint  forces.  Disadvantages  include  the  use  of  a  large 
number  of  non-minimal  generalized  coordinates,  the 
underlying  differential-algebraic  equation  (DAE)  structure 
of  the  equations  of  motion,  and  the  need  for  error  control 
techniques  to  manage  constraint  error  growth  during  a 
simulation. 

Tree-augmented  (TA)  method:  The  second  method  is  the 
tree-augmented  (TA)  dynamics  method.  In  this  method,  a 
minimal  set  of  the  inter-body  constraints  are  “cut”  to  obtain 
the  tree-topology  sub-system.  The  maximal  spanning  tree 
based  tree  sub-system  only  has  hinges  as  illustrated  in  Figure 
4(b).  The  overall  dynamics  model  consists  of  the  minimal- 
coordinate  dynamics  model  for  the  tree  sub -system  together 
with  a  minimal  set  of  closure  constraints.  The  number  of 
generalized  coordinates  and  closure  constraints  is  much 
smaller  compared  with  the  FA  model.  The  tree  system’s 
mass  matrix  however  is  dense  and  configuration  dependent, 
though  low-order  recursive  algorithms  are  available  for 
solving  the  tree  system  dynamics  without  requiring  mass 
matrix  inversion.  The  underlying  formulation  remains  a 
DAE,  but  constraint  error  control  is  only  needed  for  the 
smaller  set  of  closure  constraints. 

Constraint  embedding  (CE)  method:  The  third  method 
is  the  new  constraint  embedding  (CE)  dynamics  method. 
This  technique  uses  the  TA  model  as  a  starting  point  and  its 
closure  constraints  are  eliminated  by  aggregating  bodies 
affected  by  the  closure  constraint  into  compound  bodies  as 
shown  in  Figure  4(c).  The  transformed  system  has  a  tree 
topology  with  only  inter-body  hinges  and  no  closure 
constraints.  The  benefit  of  this  minimal  coordinates 
approach  is  that  low-order  tree  algorithms  can  be  directly 
used  to  solve  the  dynamics.  Also,  this  formulation  results  in 
an  ordinary  differential  equation  (ODE)  instead  of  a  DAE, 
and  constraint  error  control  techniques  are  not  required.  This 
method  however  is  more  complex  to  implement,  since  the 
aggregated  bodies  now  contain  multiple  rigid  bodies  and 
have  configuration  dependent  geometry.  While  CE  method 
shares  the  minimal  coordinates  attribute  with  projection 
dynamics  techniques,  its  advantage  lies  in  the  preservation 
of  the  system’s  tree  topology  that  is  necessary  for  the  use  of 
the  structure -based  tree  algorithms. 


Dynamic  Model  Performance 

The  HMMWV  vehicle  model  built  in  ROAMS  has 
essentially  15  degrees  of  freedom  (DOF)  after  taking  into 
account  all  the  constraints  on  the  system.  In  addition  to  the 
constraint  embedding  (CE)  HMMWV  vehicle  model,  we 
also  implemented  tree  augmented  (TA)  and  fully  augmented 
(FA)  models  of  the  vehicle.  These  three  modeling 
approaches  were  evaluated  in  terms  of  speed  by  simulating 
the  suspended  HMMWV  subjected  to  external  disturbances, 
such  as  those  from  the  terrain.  The  table  below  lists  the 
number  of  coordinates  required  by  the  different  approaches, 
as  well  as  their  speed  performance. 


Method 

No.  of 
coord¬ 
inates 

No.  of 
constr¬ 
aints 

Augment¬ 
ed  size 

Sim  time 
ratio 

CE 

15 

0 

15 

1 

TA 

45 

30 

75 

4.1 

FA 

216 

201 

417 

120.0 

As  described  earlier,  the  FA  model  treats  all  bodies  as 
independent  rigid  bodies  and  treats  all  hinges  as  bilateral 
constraints  between  the  bodies.  The  FA  model  has  216 
coordinates  with  the  size  of  the  bilateral  constraints  being 
201.  As  expected  the  difference  between  them  is  15,  which 
is  the  number  of  essential  independent  coordinates  for  the 
system.  However  the  size  of  the  equations  of  motion  is 
determined  by  the  sum  of  these  numbers  which  works  out  to 
417  for  the  FA  model.  The  TA  model  uses  minimal 
coordinates  for  the  spanning  tree  of  bodies  in  the  model, 
together  with  a  minimal  set  of  bilateral  constraints  for  the 
joint  cuts  used  to  obtain  the  spanning  tree.  The  size  of  this 
model  is  much  smaller  with  45  tree  coordinates  and  bilateral 
constraints  of  size  30.  The  CE  model  uses  constraint 
embedding  to  eliminate  even  these  remaining  constraints  in 
the  TA  model.  The  size  of  the  CE  model  is  the  minimal  15 
size  and  there  are  no  additional  bilateral  constraints.  The  last 
column  in  the  table  compares  the  relative  simulation  time  for 
each  of  these  models  for  the  same  time  step  size  and 
simulation  duration.  The  TA  model  is  4  times  slower,  while 
the  FA  model  is  120  times  slower.  These  short 
benchmarking  runs  did  not  include  constraint  error  control 
for  the  TA  and  FA  model  runs  that  would  otherwise  be 
required  for  the  longer  runs. 

ENVIRONMENT 

We  ran  vehicle  simulations  in  two  main  environments.  The 
first  was  an  urban  environment.  The  second  was  an  off-road 
environment.  In  both  cases  we  created  a  graphical 
representation  of  the  environment  with  a  variety  of  tools 
described  below.  We  then  took  this  graphical  representation 
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and  extracted  a  digital  elevation  map  from  it  for  use  in  the 
vehicle  wheel-terrain  contact  simulation.  Additionally,  the 
original  graphical  representation  of  the  environment  was 
used  by  the  LIDAR  sensor.  For  this,  the  graphical 
representation  was  rendered  in  OpenGL. 

Urban  Environment 

The  environment  consisted  of  a  3D  mesh  model  of  a  city. 
The  mesh  was  created  using  a  commercial  tool  called 
CityEngine  [8].  CityEngine  generates  realistic  urban 
environments,  which  can  be  exported  to  3D  mesh  files.  We 
imported  the  CityEngine-generated  meshes  into  the 
simulation. 


Figure  5:  Urban  environment  created  by  CityEngine 


The  simulation  requires  a  digital  elevation  map  for 
simulating  a  vehicle's  interaction  with  the  ground.  We 
extracted  a  digital  elevation  map  from  the  CityEngine- 
generated  meshes. 


Figure  6:  Depth  map  for  urban  environment  created  by 


CityEngine 

Off-Road  Environments 

We  also  simulated  the  vehicle  on  off-road  environments. 
Off-road  environments  consisted  of  bumpy  terrain  (as 
opposed  to  the  paved  flat  urban  environment).  To  create  the 
bumpy  off-road  environments,  we  generated  a  digital 
elevation  map  using  the  Height  Map  Editor  tool  [9].  This 
tool  creates  random  elevation  maps  with  natural -looking 


terrains  with  hills  and  valleys.  We  took  this  elevation  map 
and  imported  into  the  simulation. 


Figure  7:  Off-road  environment 


SENSORS 

We  simulated  LIDAR  using  the  simulator's  graphics 
system.  We  rendered  the  3D  scene  (in  OpenGL)  and  read 
back  the  depth  buffer  in  a  raster  that  matched  the  raster 
characteristics  of  a  typical  LIDAR  unit.  We  treated  these 
depth  values  as  a  simulated  flash  LIDAR  output. 

The  simulation  system  uses  the  SPICE  [10]  system  to 
determine  relative  frames  of  objects  with  respect  to 
planetary  bodies.  We  used  this  capability  to  simulate  GPS 
coordinate  lookup.  We  converted  the  vehicle  local  terrain 
patch  coordinates  into  geographic  coordinates. 


Figure  8:  Simulation  showing  simulated  LIDAR  (bottom 


right)  and  GPS  output  (top-left) 

The  view  out  the  driver’s  window  that  is  shown  in 
Scenario  1  shows  the  camera  sensor  used  in  ROAMS 
simulations.  The  HMMWV  simulation  did  not  include 
stereo  cameras,  but  it  could  have  very  easily  (since  we  have 
implemented  stereo  camera  models  and  derived  3-D  stereo 
surface  reconstruction  in  other  ROAMS  simulations).  If  we 
had  implemented  stereo  cameras  in  the  simulation,  the 
camera  models  would  display  a  live  feed  of  the  view  from  of 
a  camera  mounted  on  the  vehicle.  Using  two  such  cameras, 
we  can  set  up  stereo  pairs  of  cameras  that  can  be  used  to  do 
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stereo  correlation  to  construct  depth  maps  for  navigational 
purposes.  The  live  camera  views  are  constructed  using  the 
graphics  subsystem.  Each  live  camera  image  would  be 
processed  by  very  accurate  camera  models  to  produce 
realistic  image  that  can  be  processed  by  standard  stereo 
correlation  codes  to  produce  realistic  depths  maps. 


and  OpenGL.  The  software  runs  on  a  standard  Linux 
computer. 

SCENARIOS 

We  performed  three  distinct  Scenarios  that  illustrate  the 
various  goals  of  the  project. 


AUTONOMOUS  DRIVING  AND  OBSTACLE 
AVOIDANCE 

In  addition  to  modeling  the  HMMWV,  we  also  developed 
a  simple  autonomous  driving  routine  for  navigating  through 
obstacles  in  an  environment.  This  autonomous  system  has 
two  parts:  sensing  and  planning.  Sensing  is  used  to  locate 
obstacles  in  the  world  while  planning  is  used  to  find  a  path 
through  the  obstacles  to  the  eventual  destination.  It  should 
be  noted  that  both  the  sensing  and  planning  can  be  swapped 
out  for  more  sophisticated  autonomy  algorithms  and  models, 
but  this  was  outside  the  scope  of  this  project. 

The  sensing  algorithm  detects  obstacles  by  directly 
querying  the  terrain  DEM  (digital  elevation  map).  The 
algorithm  works  by  asking  the  terrain  for  the  absolute  height 
at  various  coordinates  and  calculating  the  relative  height 
with  respect  to  the  HMMWV’ s  current  ground  plane.  If  the 
relative  height  is  above  a  certain  threshold,  it  is  marked  as  an 
obstacle  and  its  footprint  is  expanded  in  the  internal 
HMMWV  map  as  a  safety  measure.  While  the  current 
sensing  model  uses  truth  data  not  normally  accessible  by  a 
real  world  system,  it  is  possible  to  utilize  data  from  a 
simulated  LIDAR  image  to  create  similar  obstacle  maps. 
The  LIDAR  is  currently  in  the  form  of  a  grid  of  range 
values.  This  can  easily  be  interpreted  as  a  point  cloud.  The 
terrain  modeling  software  has  procedures  to  take  point 
clouds  and  convert  them  to  its  native  digital  elevation  map 
representation,  which  can  be  used  for  vehicle  simulation. 

The  motion  planning  algorithm  is  based  on  an  arc  planner 
that  draws  a  number  of  arcs  from  the  HMMWV ’s  current 
location.  The  planner  checks  each  arc  to  see  which  are  clear 
of  obstacles,  and  selects  the  obstacle-free  arc  that  brings  the 
HMMWV  closest  to  its  goal.  The  arcs  are  recalculated  at  a 
set  delta  time  AT.  This  planning  algorithm  can  easily  be 
swapped  out  an  alternate  algorithm  such  as  a  D*  path 
planning  algorithm. 

SIMULATION  PLATFORM 

The  ROAMS  HMMWV  vehicle  simulation  runs  on  a 
Linux  computer  running  the  Fedora  Core  operating  system 
(version  17).  Most  of  the  software  is  written  in  C++  in  order 
to  run  efficiently  as  possible.  However,  Python  is  used 
extensively  during  simulation  setup  to  construct  the  C++ 
parts,  connect  them  together  and  install  the  user-specified 
parameters  to  configure  the  simulation.  Visualization  is 
done  using  custom  3D  graphics  software  based  on  OGRE 


Scenario  1  -  Urban  driving  with  navigation  and 
obstacle  avoidance 

In  this  scenario  we  used  an  urban  terrain  and  defined  a 
goal  point  a  few  hundred  meters  away.  We  then  let  the 
vehicle  run  and  it  drove  towards  the  goal.  The  navigation 
system  detected  the  raised  edges  of  the  road  and  avoided 
them.  This  produced  a  natural  motion  towards  the  goal  that 
avoided  the  obstacles  (curbs  in  this  case).  We  have  run 
additional  simulations  where  a  cylindrical  obstacle  was 
placed  in  the  path  and  the  vehicle  avoided  it  successfully. 
See  Figure  9  and  its  caption  to  note  several  key  features  of 
the  scenario.  Note  that  the  odd  stripping  on  the  road  is  an 
artifact  of  the  rendering  of  the  output  of  the  CityEngine  tool. 

This  simulation  ran  at  about  half-real  time;  however,  it 
should  be  noted  that  the  simulation  includes  significant 
overhead  for  graphics,  LIDAR  modeling,  path  planning, 
navigation,  etc.,  and  that  the  multibody  dynamics  alone  runs 
significantly  faster  than  real  time.  Due  to  limited  time, 
overall  performance  optimization  was  deferred  in  favor  of 
developing  more  realistic  urban  and  off-road  ground 
scenarios,  but  we  believe  that  real-time  performance  is  well 
within  reach. 


Figure  9:  Scenario  1  -  Urban  driving  with  navigation 
and  obstacle  avoidance.  From  the  top  left  of  the  figure 
going  clock- wise,  note  these  features:  (a)  GPS  output,  (b) 
the  simulated  LIDAR  output  is  shown  in  gray  levels,  (c)  data 
logging  records  and  plots  various  vehicle  telemetry,  (d)  a 
sample  driver’s  view. 


Real-Time  and  High-Fidelity  Simulation  Environment  For  Autonomous  Ground  Vehicle  Dynamics,  Cameron,  et  al. 


UNCLASSIFIED 


Page  7  of  1 1 


Proceedings  of  the  2013  Ground  Vehicle  Systems  Engineering  and  Technology  Symposium  (GVSETS) 


For  robust  operation  with  the  navigation  algorithm  that  we 
used  for  this  scenario,  the  vehicle’s  speed  is  capped  at  5m/s 
(approximately  llmph).  This  allows  the  navigation  to  make 
more  accurate  estimates  of  the  vehicle’s  trajectory  and 
reduces  the  dynamic  effects  of  the  suspensions. 

Scenario  2  -  Urban  driving  -  Lane  Change 
Maneuver 

In  the  second  scenario,  we  drove  the  vehicle  in  the  urban 
environment  and  did  a  simple  open-loop  lane  change 
maneuver  at  speed  to  demonstrate  the  realistic  nature  of  the 
vehicle  dynamics. 

In  this  demo,  the  HMMWV  is  accelerated  to  about  20  m/s 
(approximately  44.7  mph)  before  it  makes  a  lane  change 
maneuver  at  30s,  maintains  the  lane  for  20s,  and  then  a 
maneuvers  back  to  return  to  its  original  lane  (at  50s).  The 
entire  simulation  lasts  for  around  60  seconds  (starting  at 
10s).  Figure  10  shows  the  vehicle  during  the  lane  change 
maneuver,  and  Figures  11-14  shows  the  vehicle  speed,  roll, 
pitch,  yaw,  lateral  acceleration,  and  yaw  rate  during  the 
maneuver. 


Figure  10:  Scenario  2  -  Lane  change  maneuver: 

Note  the  roll  of  the  vehicle  as  it  changes  lanes 
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Figure  11:  Scenario  2  -  Vehicle  speed  during  lane  change 
maneuver 


Figure  12:  Scenario  2  -  Roll,  pitch,  and  yaw  during  lane  change 
maneuver 


Figure  13:  Scenario  2  -  Lateral  acceleration  during  lane  change 
maneuver 


Figure  14:  Scenario  2  -  Yaw  rate  during  lane  change  maneuver 
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Scenario  3  -  Off-Road  Driving  Teleoperation 

In  Scenario  3,  we  drove  the  vehicle  at  various  speeds  on 
off-road  terrain  with  a  few  trees  to  demonstrate  vehicle 
behavior.  Note  that  the  tire-terrain  interaction  is  based  on 
Bekker’s  formulas.  It  basically  treats  the  tire  as  rigid  but 
lumps  all  the  tire-soil  spring-damper  interaction  into  the  soil 
(as  if  the  vehicle  as  driving  over  a  soft  or  rubbery  terrain. 
The  terrain  characteristics  were  chosen  to  represent 
relatively  firm  soil. 

This  scenario  did  not  use  the  navigation  and  obstacle 
avoidance  algorithms  (although  it  could  have).  We  let  the 
operator  control  the  motion  of  the  vehicle  with  a  joystick 
that  controls  the  vehicle’s  velocity  vector. 


Figure  15:  Scenario  3  -  Off-road  vehicle  driving  using 


joystick  control 

CONCLUSIONS 

Current  ground  vehicle  simulations  used  by  the  U.S.  Army 
require  a  significant  trade-off:  If  the  vehicle  model  is  of 
high  fidelity,  it  operates  too  slowly  to  be  useful  for  typical 
analysis  purpose  such  as  sensor  testing  and  development. 
Only  vehicles  with  very  low  modeling  fidelity  operate  fast 
enough  to  be  useful  for  typical  autonomous  vehicle  analysis 
tasks. 

The  ROAMS  HMMWV  simulation  successfully 
demonstrates  that  high  fidelity  multibody  dynamics,  terrain 
models,  sensors,  actuators,  control,  and  navigation  in  urban 
and  off-road  scenarios  can  be  modeled  and  run  at  speeds  that 
are  useful  for  vehicle  analysis  and  design  purposes.  Even 
without  significant  attempts  to  optimize  performance,  the 
most  complex  ROAMS  HMMWV  simulation  runs  at  near 
real-time.  Although  it  was  not  demonstrated  explicitly  in 
the  scenarios,  the  architecture  of  ROAMS  allows  models  of 
varying  complexity  to  be  swapped  in  and  out  as  desired  for 
hardware,  sensors,  and  control  and  navigation  algorithms. 
All  component  models  allow  adjustment  of  run-time 
parameters  to  vary  system  behavior  however  the  analyst 
wishes. 


In  this  research,  we  have  demonstrated  that  the  ROAMS 
HMMWV  simulation  is  a  fast,  powerful  tool  for  future  U.S. 
Army  vehicle  analysis  and  design  work. 

Future  Work 

There  are  a  variety  of  improvements  that  can  be  done  on 
this  vehicle  model.  These  include  improving  the  model 
fidelity  by  incorporating  the  flexibility  of  the  bushings  used 
in  some  of  the  joints  of  the  HMMWV  suspension,  adding 
flexibility  to  the  chassis,  improving  the  sensor  models,  using 
the  LIDAR  output  in  the  navigation,  integrating  with 
realistic  autonomy  software,  and  more. 

Although  the  current  model  captures  many  essential 
aspects  necessary  for  accurate  simulation  of  vehicle 
behavior,  several  potential  improvements  are  topics  for 
future  work.  Among  these  are  the  addition  of  an  anti-roll  bar 
and  compliant  rubber  bushings  in  the  suspension,  better 
modeling  of  the  drivetrain  and  steering  column,  and 
implementation  of  a  tire  model  that  has  been  verified  for 
HMMWV  tires.  Further  validation  against  measured  vehicle 
data  is  also  needed,  to  ensure  that  the  model  captures  the 
true  driving  characteristics  of  the  HMMWV. 

Integration  with  more  advanced  closed-loop  control  and 
autonomy  algorithms  is  another  topic  for  future  work. 
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APPENDIX  -  MULTIBODY  DYNAMICS  WITH  LOOP 
CONSTRAINTS 

The  following  appendix  includes  an  overview  of  the 
mathematical  theory  of  the  constraint  embedding  approach 
described  in  this  paper  and  used  in  our  HMMWV  suspension 
model.  More  details  about  the  following  material  can  be 
found  in  [6]. 

As  we  have  seen  in  the  section  on  “Closed-Chain 
Suspension  Modeling”,  each  of  the  FA,  TA  and  CE  models 
consist  of  a  tree  topology  sub-system  subject  to  a  set  of 
closure  constraints.  The  specific  details  of  the  decomposition 
vary  with  the  model  type.  For  the  FA  model,  the  tree  system 
is  simply  a  collection  of  independent  bodies,  while  the  set  of 
closure  constraints  is  large.  The  CE  model  represents  the 
other  extreme,  where  the  entire  model  is  a  tree  topology 
system,  and  there  are  no  additional  closure  constraints.  The 
TA  model  is  a  hybrid,  with  a  maximal  spanning  tree  based 
tree  topology  system,  together  with  a  minimal  set  of  closure 
constraints.  In  this  section  we  study  the  general  approach  to 
solving  the  closed-chain  equations  of  motion  for  such 
models  consisting  of  tree  topology  systems  with  closure 
constraints.  Using  N  to  denote  the  number  of  degrees  of 
freedom  for  the  tree  sub-system,  the  minimal  coordinates 
equations  of  motion  for  the  tree-topology  sub-system  can  be 
expressed  as 

M(9)  e  +  e(9,  9)  =  7  a) 

where  the  configuration  dependent,  symmetric  matrix 
jvc(0)  g  J  is  the  mass  matrix  of  the  system, 

6(0,  0)  G  7Z  denotes  the  velocity  dependent  Coriolis 

and  gyroscopic  forces  vector,  and  T  £  denotes  the 

applied  generalized  forces.  The  mass  matrix  is  positive- 
definite  and  invertible  for  tree-topology  systems.  Let  nc 
denote  the  dimensionality  of  the  closure  constraints  on  the 

system,  Then  there  exists  a  Gc(0,t)  ellv  Lc  X  ^  matrix 
and  a  U(t)  £  7Znc  vector  that  defines  the  velocity 
domain  constraint  equation  for  the  holonomic  and  non- 
holonomic  closure  constraints  on  the  system  as  follows: 

Gc(0,t)  0  =U(t)  (2) 

This  differential  form  of  the  constraints  is  also  referred  to  as 
a  Pfajfian  form.  We  assume  that  Gc  (0,  t)  is  a  full-rank 
matrix.  Observe  that  Eq.  2  is  linear  in  the  0  generalized 
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velocity  coordinates.  These  constraints  effectively  reduce  the 
independent  generalized  velocities  for  the  system  from  ^\l 
to  an  (3N  —  Tlc )  dimensional  linear  space,  The  dynamics 
of  closed-chain  systems  can  be  obtained  by  modifying  the 
tree  system  dynamics  in  Eq.  1  to  include  the  effect  of  the 

closure  constraints  via  Lagrange  multipliers ,  A  6  JZn°  , 
as  follows 

M(0)  0  +  e(0,  0)  -  G*(0,  t)A  =  T 

Gc(0,t)  0  =  U(t)  (3) 

The  —  G*(0,t)A  term  in  the  first  equation  represents  the 
internal  generalized  constraint  forces  from  the  closure 
constraints2. 

By  differentiating  the  constraint  equation,  Eq.  3  can  be 
rearranged  into  the  following  descriptor  form: 


/  M  G*  \ 

l 

:CD 

i _ 

1 

CD 

_ i 

V  Gc  0  J 

i - 

1 

> 

i _ 

- 1 

_ i 

(4) 


where  U  =  U(t)  -  Gc  0  €  TVXc 


One  approach  to  solving  the  closed-chain  dynamics 
equations  of  motion  is  to  assemble  the  matrix  on  the  left  and 
the  vector  on  the  right  in  Eq.  4  and  solve  the  linear  matrix 

equation  for  the  0  generalized  accelerations.  This  is 
especially  attractive  for  the  FA  model,  since  the  JVt  matrix 
for  this  case  is  block  diagonal  and  constant.  Indeed,  the 
whole  matrix  is  highly  sparse  for  this  case.  This  approach  is 
analyzed  in  detail  in  reference.  We  on  the  other  hand  pursue 
an  alternative  Schur  complement-based  solution  approach 
for  the  FA  and  TA  models  as  described  in  the  following 
lemma.  For  details  about  this,  please  see  [6]. 

The  closed-chain  dynamics  generalized  accelerations  in  Eq. 
4  can  be  expressed  as 

0  =  0f  +  06  (5) 


where  the  free  generalized  accelerations,  0f,  the  correction 

generalized  accelerations,  06  ,  and  the  Lagrange 

multipliers,  A,  are  given  by 


2  Throughout  this  appendix,  an  asterisk  superscript  means 
transpose. 


0f  =  JvrMT-e) 

A  =  —  [GCM_1G*]_1  y 

06  =  Jvt-1G*  A  (6a“6c) 

/\  r 

where  y  =  Gc0f— U 

The  0f  =  3Vt—  —  C)  term  represents  the 
generalized  accelerations  solution  for  the  dynamics  of  the 
tree  system  while  ignoring  the  closure  constraints  and,  is 
therefore  referred  to  as  the  free  generalized  accelerations. 

V  represents  the  acceleration-level  constraint  violation 
resulting  from  just  the  free  dynamics  of  the  system.  The 
GcM_1G*  matrix  in  Eq.  6b  is  the  Schur  complement  of  the 
matrix  on  the  left  hand  side  of  Eq.  4.  An  intuitive 
interpretation  of  Eq.  6b  is  that  the  constraint  error  spatial 
accelerations  from  the  free-dynamics  solution,  together  with 
the  Schur  complement  matrix  allow  the  computation  of  the 
constraint  forces  necessary  to  nullify  the  errors.  Once  the 
constraint  forces  are  available,  Eq.  6c  uses  them  to  obtain 
the  generalized  accelerations  to  correct  the  free  system 
dynamics  solution.  In  summary,  the  solution  to  the  closed- 
chain  forward  dynamics  thus  conceptually  involves  the 
following  steps: 

1.  Solve  Eq.  6a  for  the  0f  free  generalized  accelerations. 

2.  Use  0f  and  the  G  c  JYt  *  G  *  Schur  complement  to 
solve  for  the  Lagrange  multipliers  via  Eq.  6b. 

3.  Use  A  to  solve  Eq.  6c  for  the  06  correction 
accelerations, 

4.  Compute  the  0  generalized  accelerations  using  Eq.  5. 

Only  the  first  step  is  needed  when  closure  constraints  are 
absent.  One  numerical  consequence  of  the  use  of  non- 
minimal  coordinates  and  closure  constraints  is  that 
differential-algebraic  equation  (DAE)  integrators,  instead  of 
the  ODE  integrators  for  tree  systems,  are  required  for  the 
numerical  integration  of  the  accelerations  and  velocities. 
Furthermore,  error  control  techniques  are  needed  to  manage 
the  growth  of  constraint  errors  that  can  cause  the  system 
state  to  drift  off  of  the  constraint  manifold. 
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